Journals
  Publication Years
  Keywords
Search within results Open Search
Please wait a minute...
For Selected: Toggle Thumbnails
A Multi-modal Sentiment Recognition Method Based on Multi-task Learning
LIN Zijie, LONG Yunfei, DU Jiachen, XU Ruifeng
Acta Scientiarum Naturalium Universitatis Pekinensis    2021, 57 (1): 7-15.   DOI: 10.13209/j.0479-8023.2020.085
Abstract1711)   HTML    PDF(pc) (3483KB)(507)       Save
In order to learn more emotionally inclined video and speech representations through auxiliary tasks, and improve the effect of multi-modal fusion, this paper proposes a multi-modal sentiment recognition method based on multi-task learning. A multimodal sharing layer is used to learn the sentiment information of the visual and acoustic modes. The experiment on MOSI and MOSEI data sets shows that adding two auxiliary single-modal sentiment recognition tasks can learn more effective single-modal sentiment representations, and improve the accuracy of sentiment recognition by 0.8% and 2.5% respectively.
Related Articles | Metrics | Comments0
An Interactive Stance Classification Method Incorporating Background Knowledge
LIU Changjian, DU Jiachen, LENG Jia, CHEN Di, MAO Ruibin, ZHANG Jun, XU Ruifeng
Acta Scientiarum Naturalium Universitatis Pekinensis    2020, 56 (1): 16-22.   DOI: 10.13209/j.0479-8023.2019.096
Abstract1254)   HTML    PDF(pc) (682KB)(163)       Save
This paper proposes a stance classification method on interactive text by incorporating background knowledge. This method retrieves relevant background knowledge texts from Wikipedia by using the interactive text as query. The retrieved background knowledge texts are encoded and then ultilized to learn the representation of relavent background knowledge through deep memory network for improving the representation learning of interactive text. The experimental results on three English online debate datasets show that the performance of interactive stance classification can be effectively improved by incorporating background knowledge through choosing the appropriate number of background knowledge embedding layers and the connection method of background knowledge embedding layer.
Related Articles | Metrics | Comments0
Sarcasm Detection Based on Adversarial Learning
ZHANG Qinglin, DU Jiachen, XU Ruifeng
Acta Scientiarum Naturalium Universitatis Pekinensis    2019, 55 (1): 29-36.   DOI: 10.13209/j.0479-8023.2018.064
Abstract910)   HTML    PDF(pc) (530KB)(321)       Save

Existing sarcasm detection approaches suffer from lack of sufficient training data. To address this problem, the authors propose an adversarial learning framework built on convolutional neural network (CNN) and attention mechanism, which is trained from limited amounts of labeled data. Two complementary adversarial learning approaches are investigated. First, by training with generated adversarial examples, the authors attempt to enhance the robustness and generalization ability of the classifier. Then, a domain transfer based adversarial learning approach is proposed to leverage cross-domain sarcasm data for improving the performance of sarcasm detection in the target domain. Experimental results on three sarcasm datasets show that both adversarial learning approaches proposed improve the performance of sarcasm detection, but the domain transfer based approach achieves higher performance. Combining the two proposed approaches further improves the performance of sarcasm detection.

Related Articles | Metrics | Comments0